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THE ACHIEVEMENT LEVEL FOR ENGLISH IN DUTCH PRIMARY SCHOOLS 1 



Paul Hulsman & Peter Edelenbos 



00 The introduction of English as an obligatory subject in Dutch primary 

education is a recent development. It was only introduced as such in 

fig 1986. The study which is the subject of this talk is the first 

large-scale investigation of this new subject. The aim of the study is 
to investigate differences in che way teachers use, on the one hand, 
grammar-based courses and, on the ether hand, communicative courses, 
and the differences in achievement level of children who were taught 
English with the two types of courses. For a good understanding of the 
results, it will be necessary to discuss to some length the nature of 
the research itself and the developments leading up to it. 

In the not too distant past the Netherlands, as for example the 
U.K., had a kind of 'eleven-plus 1 exam. The 'better' pupils of primary 
schools, i.e. those who were supposed to move up to grammar school, 
were taught French in their spare time, to prepare them for the 
regular education in that language in secondary school. However, the 
results of these preparatory lessons were on the whole disappointing, 
and there was a growing feeling that they were obsolete, so they 
gradually disappeared in the sixties. 
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In 1970, the preliminary version of a new act on Dutch primary 
v education was published. It proposed to Include English as a new 
obligatory subject 1n the curriculum. In various places projects were 
started to prepare for this event. The development of English in 
primary education was much boosted when the National Institute for 
Curriculum Development, the SLO, began to take part. This Institute 
was to become one of the driving forces behind the development of 
English as a primary school subject. 

In 1981 the Primary Education Act was passed, which provided that 
in 1986 English was to become an obligatory subject 1n the primary 
school curriculum for the two highest grades. From 1981 onwards more 
and more schools started to include English in their timetables, until 
in 1985 more than 55 per cent of primary schools taught English 1n one 
form or another. At the same time, designers and publishers of course 
materials began to design courses for English in primary education. 

One of these course designers was the SLO, the National Institute 
for Curriculum Development. They did more than that, however. For 
example, they formulated a set of six goals for English 1n primary 
education, which was generally adopted by those working 1n that field. 
They also designed a multi-media course for the in-service training of 
primary school teachers. This was necessary because 1t had been 
decided that no extra teachers would become available for teaching 
English. This should be done by members of the existing school teams, 
the vast majority of whom have no qualifications for the teaching of 
English. Although the course was not obligatory it was a success: 
around 15,000 teachers took part 1n it. There are some 8,000 primary 
schools 1n the Netherlands, so on average two teachers of each school 
participated in this In-service training. 

The SLO based all Its work, which involved years of effort and a 
large amount cf money, on the communicative approach to language 
teaching. They naturally wanted to know what the effects of this 
approach are, compared with the effects of the more traditional, 
grammatical approach. They therefore commissioned a research project, 
to be conducted by RION, an institute for educational research 1n 
Groningen. 
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This project ran from January 1986 to January 1988, and Involved 
112 primary schools and around 2,100 pupils, all In grade 8, the 
highest grade in primary school. They were tested with the same 
Instruments twice. All results presented here were obtained In the 
second round of testing. 

Anyone who is a linguist or a language teacher has a more or less 
specific notion of what the two approaches mentioned entail. However, 
there Is no generally accepted unified definition of either. From the 
mld-seventees onwards several publications appeared (among them 
Hilkins, 1977; Widdowson, 1978; Brumfit and Johnson, 1979, Johnson, 
1979; Johnson and Porter, 1983) in which ideas about language teaching 
were developed which were soon summarized under the heading of the 
'communicative approach.' Usually these ideas were contrasted with the 
traditional practice in language teaching: the 'structural-grammatical 
approach.' For the sake of convenience I will refer to the latter as 
'the grammatical approach'. 

Basing your research on the concept of 'approach' poses a problem. 
The problem Is that in the day-to-day practice of teaching and 
learning a language 'approaches' as such do not exist. They are 
theoretical constructs. To a certain extent, the designers of course 
materials may adopt such a construct as a guiding principle for their 
work. In other words, courses for English In primary education reflect 
the choices made by thei; designers, and by studying them one may 
determine to what extent they represent a certain approach. Besides, 
courses materials for English are used in 97 per cent of Dutch primary 
schools. As the vast majority of primary school teachers has no 
qualifications for teaching English they are, to a very large extent, 
dependent on these course materials. 

We therefore decided to take the available course materials as a 
starting point for our investigation and finally included eight 
courses in our research. In Table .1 you find their names, the 
approach they represent and what we call their 'approach score'. 



ERIC 



Table 1. Approach Scores for 8 courses for English 1n Primary Education 



Course* 


Score 


Communicative approach 




No Problem 


430 


Engels Baslsonderwl js 


379 


Units 


O A ft 

348 


Nixed approach 




Real English 


312 


Junior Contact 


262 


Ticket to Britain 

■ iv*r\ct iu oi i tain 


1 A O 

243 


Grammatical annrnarh 




Now for English 


172 


Ready Steady Go! 


151 



Mean 287.4 



In September 1986, these eight courses were used 1n 88 per cent of 
Dutch primary schools, with a large majority opting for communicative 
courses and only very few using grammatical ones. 

The 'approach score' 1s our solution to the problem of assigning 
the courses to one of the approaches. On the basis of the relevant 
literature we dlscarned six areas where the courses should differ if 
they were either communicative or grammatical. These areas are: 

- the Importance and the treatment of grammatical structures; 

- the organization of the subject matter; 

- the structure of the lessons; 

- the type of excerdses; 

- the tolerance towards errors when using the language; 

- the vocabulary. 



On the basis of these criteria we designed a scale containing 23 
statements, such as: 

- pupils are confronted with authentic language situations; 

- the goals of the course stress the communicative skills of pupils 

- the correct use of rules 1s seen as essential for the 
use of a foreign language; 

- In the first phase of each lesson the stress Is on the 
Introduction and/or practicing of a grammatical structure; 

- grammatical structures are only presented If they are necessary 
for better communication; 

- the course has a thematic structure, I.e. several lessons revolve 
around a certain theme. 

These 23 statements were presented to a number of judges, who were to 
Indicate on a scale from 1 to 5 to what extent they agreed with each 
statement In relation to a certain course for English. The judges 
proved to be quite consistent In their opinions, and the scale was 
very homogeneous and reliable. On the basis of their judgments a score 
was computed for ^ac'i English course. The higher the score, the more 
communicative the cour:*> Is. The mean score for the eight courses is 
288. 

The three courses which are close to this mean, Real English . 
Junior Contact, and Ticket to Britain were given the label 'mixed 
approach', which should be understood as 'communicative In approach, 
but with a great deal of attention paid to the structural features of 
English'. The differences between these three and the clearly 
communicative courses on the one hand, and the clearly grammatical 
courses on the other, were so conspicuous that we felt we should not 
force them Into either of those two categories so as to preserve the 
neat dichotomy of 'communicative' versus 'grammatical'. We therefore 
ended up with three, Instead of two, categories. 

At the same time we were conducting an extensive analysis of the 
content of the eight courses. We examined the following points: themes 
and topics, vocabulary, and the number and nature of the exercises. 




As far as themes and topics are concerned, I.e. what the lessons 
are about, there is hardly any difference between the courses. For 
example, they all cover: introducing yourself, the family, buying 
things, colours, clothing, eating and drinking, and parts of the body. 
This also means that there is much overlap in the vocabulary offered. 

Chart 1. Total Number of Exercises in 8 Courses for English in Primary 
Education 



No Problem 

Engels Basisonderwi js 
Units 

Real English 
Junior Contact 
Ticket to Britain 
Now for English 
Ready Steady Go! 









568 




265 








559 










453 




769 




1 




549 

1 1 i 




1 1 1 i i 



830 



834 



100 200 300 400 500 600 700 800 900 



There are great differences between the courses in the total 
amount of subject matter, and the way this is sub-divided. For the 
purpose of our study we defined the amount of subject matter in a 
course as the total number of exercises in that course. In this 



context •exercise' 1s broadly defined: for example, a class discussion 
about English words 1n Dutch usage 1s also considered an 'exercise'. 
Most exercises 1n the courses are nevertheless Intended for the pupils 
to actively practise a language skill. 

As you can see in this chart there are great differences *n Ihe 
total number of exercises in the various courses; Enoels 
Basisonderwiis has by far the least number of exercises, only 265, Now 
for English has most with 834, beating Real English ^«th a margin of 
just 4. 

In order to classify these exercises we had them examined by 
judges, who were to assign them to one of seven subject matter 
categories. These categories are: 

- listening; 

- reading; 

- writing; 

- speaking; 

- grammar; 

- language examination; 

- games. 

The first four of these, listening, reading, writing, and 
speaking, need no explanation: they are the four basic language skills. 

Ne chose to Include 'grammar' as a separate category because the 
degree of attention paid to grammar is perhaps the most important 
criterion for determining the approach adopted 1n a course. An 
exercise 1s seen as a 'grammar 1 exercise when Its explicit purpose is 
the exercising of a grammatical structure or feature. For example, a 
pattern drill 1s a typical 'grammar' exercise. 

'Language examination' includes things such as the already 
mentioned class discussion about English words 1n Dutch usage, the 
collecting of such words from Dutch newspapers and magazines, 
discussions of aspects of British or American culture, and so on. 
'Games', finally, needs no explanation either. 



TabU *" En e gluJloJr?e f s E " rC,SeS for ' SubjKt Hatter Cate <>° r,es ,n 8 



No Problem 

Engels Basisonderw. 

Units 

Real English 
Junior Contact 
Ticket to Britain 
Now for English 
Ready Steady Go! 



*v* / / / / ^ 



18 12 13 31 

20 5 15 38 

21 12 19 22 
10 22 13 27 

20 16 10 29 
I 4 6 18 30 

21 10 9 25 28 
9 7 10 37 33 



2 20 3 
6 9 6 

3 18 5 
21 5 3 
18 3 4 
30 2 1 

1 1 

4 1 




The table shows a number of Interesting things. Perhaps the most 
Interesting is that all courses, independent of the approach they 
adopt, devote the highest percentage of exercises (roughly one quarter 
to one third of the total) to speaking. There are also marked 
differences in the percentage of grammar exercises, which to a certain 
extent correspond with the approach adopted: grammatical courses 
contain more grammar exercises than communicative courses. The 
categories 'language examination' and 'games' are most represented In 
the communicative courses. There are also marked differences between 
the percentages devoted to listening, reading and writing, but these 
do not reflect differences in approach. 

Although it is interesting to see that there are great differences 
in content between the courses it is more Interesting to determine how 
much time in class is actually devoted to the various categories. We 
compiled this information from questions posed to each teacher as to 
how much time he or she devoted to the various categories. 



Table 3. Percentage of Class Time Devoted to Subject Hatter CategoHe 



/ 



No Problem 


22 


12 


8 


21 


5 


9 


23 


Engels Basisonderwi j s 


22 


13 


10 


23 


8 


7 


17 


Units 


19 


12 


15 


26 


6 


6 


15 


Real English 


18 


14 


14 


21 


11 


8 


14 


Junior Contact 


23 


17 


16 


25 


7 


6 


10 


Ticket to Britain 


19 


16 


15 


23 


12 


6 


9 


Now for English 


17 


15 


16 


24 


10 


9 


10 


Ready Steady Go! 


26 


13 


15 


20 


14 


5 


7 



20 14 14 23 9 7 14 

On the whole speaking Is still the most dominant category but 
listening, reading and writing get much attention, too. 
There are only significant differences between the amourt of time 
devoted to grammar and games, as was also the case with the number of 
exercises for these categories. For the sake of comparison we have 
brought these figures together In one table (Table 4). 

All user groups spend more time on games than could be expected 
from the percentage of game exercises in the various courses. 
Apparently this kind of exercise takes up more time than those from 
other categories, and In most cases teachers tend to prefer them 
slightly to other kinds of exercises, i.e. they are not often skipped. 
Nevertheless, more time is devoted to games by teachers using 
communicative courses than by those using grammatical courses. 



Table 4. Percentage of Grammar and Games Exercises 1n 8 Courses for 

English 1n Primary Education and Time Spent 1n Class on these 
exercises 



GRAMMAR 



GAMES 



Percentage 
in Course 



Percentage 
Lessontime 



Percentage 
in Course 



Percentage 
Lessontime 



No Problem 2 

Engels Basison. 6 

Units 3 

Real English 21 

Junior Contact 18 

Ticket to Brit. 30 

Now for English 28 

Ready Steady Go! 33 



5 
8 
6 
11 
7 
12 
10 
14 



3 
6 
5 
3 
4 
1 
1 
1 



23 
17 
15 
14 
10 

9 
10 

7 



Where Ticket to Britain, one of the 'mixed approach 1 courses, or 
Ready Steady Go! , a grammatical course, are used more time 1s spent on 
grammar, as Is the case with Real English , the other 'mixed approach' 
coirses. The users of communicative courses do not spend that much 
time on grammar exercises, in keeping with the relatively low 
percentage of that kind of exercise in their courses. 

There are also marked differences between the user groups of the 
various courses with respect to the total amount of time spent on the 
teaching of English. 

Incidentally, English has a very modest place in the Dutch primary 
school curriculum: only around 3 per cent of the total lesson time 
available is devoted to It. But even this small percentage shows 
considerable variation, as you can see in Chart 2. 



ERLC 



Chart 2. Total Amount of Time Spent on English in Primary Education 



No Problem 



Engels Basisonderwi js 



Units 



Real English 



Junior Contact 



Ticket to Britain 



Now for English 



Ready Steady Go 



10 20 30 40 50 60 70 80 90 

Hours 

The chart shows the total amount of time devoted to English in 
grades 6, 7 and 8. Ready Steady Go! is a clear winner here, which is 
caused by the fact that it is the only course regularly used In grade 
6. The low scores for No Problem , Real English and Junior Contact are 
caused by the fact that at the time of our study these courses had 
only very recently been introduced; schools simply had not had the 
opportunity to work with them for a longer period. 

These differences are partly reflected in the percentage of 
subject matter dealt with in class. None of the various user groups 
manage to cover the entire course they are working with. Teachers 
using Engels Basi sonderwi j s cover 60 per cent of all exercises, those 
using Real English only 22 percent. Teachers using the communicative 
courses manage to cover a significantly higher percentage of subject 
matter. There are two, partly overlapping, explanations for these 
differences, which I have already mentioned. The first is that some of 
these courses had only recently been introduced in the schools (in 



J c2 

56 

40 
4© 

J 50 

ZD* 

71 



particular Real English). The other 1s that some courses (again Real 
English, and also Now for English ) offer a very large number of 
exercises. It 1s Interesting that the users of No Problem succeed In 
covering a relatively high percentage (541) of the subject matter, 
despite relatively nttle time devoted to English. Apparently users of 
communicative courses can 'do' a higher precentage of subject matter 
1n the same amount of time. 

On the whole 1t appeared that, as far as the subject matter to be 
presented 1s concerned, the teachers quite faithfully followed the 
Instructions given 1n the manuals of the courses, I.e. they 'did 
things by the book', and did not skip many exercises. 

We also Investigated the way .n which they presented che subject 
matter, I.e. the way 1n which they actually taught. Here 1t appeared 
that especially teachers using communicative courses 1o not adopt the 
guidelines presented 1n the manuals. They Instruct their pupils 1n 
more or less the same manner as when teaching Dutch or arithmetic. 
This 1s partly due to the fact that the manuals do not provide them 
with detailed principles for Interactive teaching, which 1s 
nevertheless a requlement for communicative language teaching. This 
ties 1n with the findings of Parkinson (1983), that communicative 
courses on the whole provide few guidelines for communicative 
teaching, and are hard to Implement. This also means that on this 
point the In-service training, *<i1ch advocated communicative teaching, 
did not work. 

All the n,dter1al that I *ave presented so far (and there 1s much 
more which I will not present for lack of time), 1s necessary for 
Interpreting the results scored by the pupils on the various tests 
which we administered. 

We developed these tests ourselves, in a fairly long process of 
construction, trail tests, adjustments made on the basis of these 
trails, and yet more trials. The final result of this development 
process is a test battery which 1s both sufficiently reliable, and 
sufficiently valid. 
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Pupils should have a certain level of proficiency 1n each of the 
four basic language skills: listening, raartlng, writing and speaking. 
We therefore developed tests for these four skills. He also developed 
two extra tests, one for vocabulary (a necessary prerequisite for all 
language activities: after all, no language without words), and for 
grammar. 

The content of the various tests 1s based on analyses of the 
subject matter and vocabulary 1n the eight courses for English. For 
example, a list was drawn up of all the words which were shared by 
most courses. This 'core vocabulary' was then used to write the tests. 
A similar list was drawn up of the grammatical features dealt with In 
the courses, which formed the basis for the grammar test. 

I will now show you some examples of the tests we developed, so 
that you can form some Idea about their nature. 

In the vocabulary test we worked with pictures. A word was 
presented, e.g. duck , and the pupils were to choose the correct 
picture from three alternatives. 



The listening test consisted of short fragments of spoken English, 
followed by a multiple choice question about each. The questions were 
of various kinds, here 1s an example of a true/ false question. The 
cue Is: "Today Is the twenty-first of August." 



b 



c 
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The reading test tested 'reading for understanding', I.e. the 
pupils should extract Information from a text presented to them. These 
texts were on the whole short or very short with just one question 
about each, but there were also some longer texts with more than one 
question. Here 1s an example of one of the shorter texts, with the 
question that goes with 1t. As you can see, the cue 1s 1n Dutch, and 
the pupils were to fill 1n a Dutch word. Other questions 1n this test 
were of the multiple choice format. 



1. Roo is op vakantie in Engeland. Op de deur van een ca-pingwinkel 
staat dit bord]e: 

From 15 April to 15 September: 
closed 12.00 to 14.00 hours 

Dit betekent! van 15 april tot 15 September 

van 12.00 uur tot 14.00 uur. 
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The grammar test was a classical multiple choice 'fill 1n the 
blank' test, with items such as this one. 



16. Peter is 1 aetre 60 centimetres, Jane 1 aetre 70 ana Vm 1 metre 

and 95 centimetres! I'm the of us ail 



a. taller 

b. tall 

c. tallest 

d. aost tall 



For the oral proficiency and writing tests we had the pupils 
perform a task. Their achievements were then marked by judges, 
graduate students of English of the University of Gronlngen. Among 
other things, they were to count the number of Dutch and English 
words, the number of grammatical mistakes, and also to give an overall 
mark for the pupil's achievement. 

Most designers of courses for English 1n primary education do not 
consider writing to be as Important as the other three primary 
language skills. The writing exercises 1n the courses make up about 10 
to 20 per cent of the total amount of exercises, and most of these 
consist of simple 'f1ll-1n-the-blank' exercises. Most courses 
nevertheless do have one or more exercises for writing a simple 
letter. We therefore had the pupils write a short letter to an 
Imaginary penfrlend 1n Britain. Here are two examples of such letters, 
the first was considered 'average' by the judges, the second 'good'. 
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Hello mijn Inlies vrind 
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I'm Wilco de vos en I hef a modder! (moeder) en a vader I to like 
playing football en playing on mij gitar, i to dislike fight because 
evrij body most can live in pice (vrede). I en mij familie to like 
play football. Doe jour familie to on football? I hef a dock en his 
name Marco. Hef you to animals? Hef a nice day. 
bay bay 



Dear Carmen 

Hello how are you doeing? I'm fine! I have two sisters Jantine she is 
foarteen jears old aan my little sister her name is joanne .he iu .iks 
jears old. I have a great motheraand a father. I have to a grandmother 
and grandfather. I love cow's but ai dont like pigs. 
My hobby's are footbal and gymnastik. We have avry Saturday football 
it's great. And we have every Wednesday gymnastik. 
Now I stop. 
Baye Baye. 



Finally, for testing oral proficiency, we had some 5 randomly 
chosen pupils from each class perform two oral tests. For the first 
test they had to imagine that they were on holiday in Britain and had 
to go to the shop to buy some things. They were given a shopping list 
in Dutch. This kind of situation in which to use the foreign language 
is present in most of the courses and so most pupils had some 
experience with it. 

For the second oral test they were to describe what they saw on 
three logically connected pictures. 
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Most of them had never practised this kind of complex task; we 
therefore expected 1t to be much harder for them than the dialogue. 

As I said before, the oral proficiency and writing tests were 
judged on several points, tut they were also given an overall mark, 
according to the marking system used 1n Dutch schools. This consists 
of a scale from 1 to 10, where 1 1s the lowest and 10 the highest 
mark. In words: 1 1s "extremely Insufficient", 10 "excellent" and 6 
"sufficient". Unlike the usual practice 1n schools, however, we 
trained our judges to make fine distinctions and to use the whole 
scale from 1 to 10. 

In the following presentation of the pupils' achievements I will 
use this scale for all tests. The results scored on the multiple 
choice tests have been transformed to 'fit' this scale. The results 
will be presented for the whole group of pupils, so not on the level 
of approach or course. These will be discussed later. 

In order to put these results 1n perspective we asked a panel of 
experts on English 1n primary education, consisting of primary school 
teachers, researchers and teachers of the In-service training, to 
examine the tests and to Indicate a number of things. 
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The first 1s the relevance of the tests for measuring the language 
skills they were supposed to measure. They could do so by marking the 
test on a scale ranging from 1 (totally Irrelevant) to 5 (hlgly 
relevant). On the whole the tests were seen as 'fairly relevant' to 
'quite relevant'; there was a high degree of conformity among these 
experts. 

The second point was the lowest marks which, 1n their opinion, 
still represented a sufficient level of proficiency 1n the various 
skills. 

The third was the percentage of all pupils that :hould score this 
lowest sufficient mark or a higher one. 

Chart 3. Marks for the Oral Proficiency Tests 



350 -r 
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There 1s a great difference between the results on the two oral 
proficiency tests (Chart 3): the relatively simple, and well-known, 
task of ordering articles in a shop does not present them with too 
much difficulties, the second, complex and unfamiliar, task proved far 
too difficult for most of them, as we expected. He therefore decided 
not to use it any further. According to the panel of experts, the 
minimum mark for the shop dialogue should be 5.8 and 63 per cent of 
the pupils should achieve this minimum level. In fact 66 per cent 
achieved it. The achievement level for oral proficiency can therefore 
be considered satisfactory for practical speech situations. More 
abstract tasks prove far too difficult for the average pupil. 

Chart 4. Marks for the Hriting Test 
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The required minimum level for the writing test is 5.7 and 54 per 
cent of the pupils should achieve this level. The actual mean score is 
only 4.5, and only 16 per cent of the pupils achieved the required 
minimum mark. 

The scores on the listening test are much better. 




Listening test 



Mean score: 6.9 
Required minimum: 6.3 

I I required 67t | 

|0 | 50 jachleved 66% 100| 

The actual mean score Is much higher than the required minimum 
mark and the required percentage Is almost reached. 

Reading test 

Mean score: 5.1 

Required minimum: 5.9 

I 1 r eq uir ed 59* I 

|0 I achi eved 24% 1 50 100| 

The reading test presents a somewhat bleaker picture. It Is the 
least relevant of the tests, according to the panel, although still 
considered 'fairly relevant 1 . The required minimum mark and 
sufficiency percentage are not reached by a long shot. This Is 
probably partly due to the fact that at the end of the test there were 
some fairly long texts with more than one question about each of them. 
These proved too difficult for most pupils. 

The grammar test also proved difficult. Only just over a quarter 
of the pupils reached the required minimum mark, and the mean score Is 
more than a point lower than the required minimum mark. 

The pupils did well on the vocabulary test, the mean score Is half 
a point higher than the required minimum mark, although the percentage 
of pupils that actually realized this minimum level Is lower than that 
required by the panel of experts. Still, It Is not too bold to state 
that the passive knowledge of words Is satisfactory. 
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The active use of words, as measured 1n the writing test and oral 
proficiency tests, leaves something to be desired, however. The pupils 
were allowed to use Dutch words 1f they could not think of English 
words, and they did so to a large extent. Only about half of the words 
thev used could be judged as being English, but many of these were 
either misspelt or mispronounced. 

So much for the presentation of the pupils' achievements 1n 
relation to the minimum standards formulated by the panel of experts. 
To sum up, 1t may be stated that on average their passive vocabulary 
1s sufficient, as 1t their oral proficiency 1n simple speech 
situations and their ability to listen for Information and read short 
and relatively simple texts. Their active vocabulary, knowledge of 
grammar, writing proficiency, and ability to read long texts or 
perform a complex speech task 1s Insufficient. 

The next step 1s to examine the differences between the groups of 
pupils using the various courses for English 1n primary education. 

The mean scores on the achievement tests present an Interesting 
picture when broken down with reference to the course used, as you can 
see 1n Table 5. As the differences are relatively small we have chosen 
to present the actual raw scores, so not transformed Into a ten 
points-scale. 

The greatest differences occur 1n the results for the listening 
and vocabulary tests, and most of all the grammar test. Pupils taught 
with Ready Steady Go! and Now for English , the two grammatical courses 
do better on the grammar test than others, especially those taught 
with Junior Contact . The same goes for the vocabulary test, although 
Junior Contact does not deviate negatively 1n this respect. 



Table 5. Scores on the Achievements Tests for the 8 Courses for 
English 1n Primary Education 



courses 



.# A 



£ & ^ £ 

N s * o" 4r 



No Problem 


14 


1 1 

l l 


4 


7 

1 


0 1 


1 Q 
1 J 


Eng il s Basisonderwijs 


13 


11 


5 


6 


21 


12 


U;i1ts 


13 


11 


4 


6 


21 


13 


Real English 


12 


10 


5 


6 


21 


12 


Junior Contact 


12 


10 


4 


6 


21 


10 


Ticket to Britain 


13 


10 


5 


6 


21 


13 


Now for English 


14 


11 


4 


6 


23 


14 


Ready Steady Go! 


14 


12 


5 


6 


24 


14 


Mean 


13 


11 


5 


6 


22 


13 



These scores are not controlled for the sodo-econesic status of 
the pupils. After correcting for SES there are still significant 
differences (p < .01) on the three tests mentioned. Pupils taught with 
the two grammatical courses still do better on the vocabulary and 
grammar tests than the others. Pupils tdught with No Problem . Now for 
English and Ready Steady Go! do better on the listening test. 

This does not mean, however, that the better achievements on thesp 
three tests are a direct result of the use of a certain course. 

For example, there are great differences 1n the amount of time 
devoted to English by the various user groups, as we have already 
spc-n. In addition, some teachers (about 1 1n 8) have a qualification 
for teaching English. There are also differences 1n the teachers' 
experience 1n teaching English and their oral proficiency. These 
factors appear to have a positive relation with the pupils' 
achievements (after these were corrected for SES). 
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Nhen these teacher and instructional characteristics are Included 
in the analysis there are still significant differences in the grammar 
test scores. Pupils taught with grammatical courses do somewhat better 
on the grammar test, but 1t is particularly the pupils taught with 
Junior Contact who score significantly lower. 

The remaining small differences 1n oral proficiency, listening, 
reading and writing proficiency, and vocabulary are not significant 
and can therefore not be attributed to the use of a certain course for 
English. In total the course used explains less than 0.5 per cent of 
the variance in pupils 1 achievements. 

As the course used does not seem to be a very important factor the 
question arises which factors do influence the pupils' achievements? 

By means of a sts^wise multiple regression analysis we determined 
which pupil, teacher, and instruction characteristics influence the 
pupils' achievements. The results are in Chart 5. 

The existing proficiency after one year of learning English --as 
measured in the pre-test— is by far the most important factor. It 
explains 52.5 per cent of variance. The two teacher characteristics 
'advanced training in English' and 'oral proficiency' explain 6.1 per 
cent and the time devoted to English another 3.6 per cent. It is 
interesting that hardly any variance Is explained by other pupil 
characteristics than 'existing proficiency'. This 1s probably due to 
the fact that we do not have data on their intelligence. 
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Chart 5. Percentages of Explained Variance of Pupils' Achievements 




A 52.5% 



A: Pupils' Existing Proficiency in English 

B: Pupils' SES 

C: Amount of Time spent on English 

D: Advanced Training of Teachers 

E: Oral Proficiency of Teacher; 

F: Unexplained Variance 
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What 1s the significance of these results for the educational 
practice? Some tentative conclusions may be drawn, the first of which 
1s that as far as pupil achievement 1s concerned 1t does not make a 
great deal of difference which course for English 1n primary education 
1s chosen. One piece of advice for teachers could be: chose a course 
that suits you yourself, I.e. choose a course that corresponds with 
your own manner of teaching. It would also be advisable to choose a 
course that 1s not overburdened with exercises. 

The amount of time spent on English does seem to matter: more 
time invested means better achievements. As many new subjects have 
recently been added to the curriculum of Dutch primary schools and the 
time that can be spent on the more traditional subjects such as Dutch 
language and arlthmatlc has become less, 1t seems unlikely that more 
time will be spent on English. A possible solution could be to start 
earlier, i.e. 1n grade 6 Instead of grade 7. 

The teacher's own proficiency 1n English and his experience 
1n teaching that subject also have a positive effect on the pupils' 
achievements. The latter will undoubtedly become higher 1n future 
simply because teachers will then have taught English for a number of 
years, but the former would have to be Improved by further training. 
It 1s unlikely that the Dutch government will want to spend money for 
this, so that this will depend on the goodwill of teachers who are, in 
many cases, already hard-pressed for time. 

On the basis of the study we conducted 1t 1s not possible to 
conclude whether English 1s a worthwhile extension of the primary 
school curriculum. More experience with the subject 1s needed for 
that. And in the end 1t will undoubtedly be the politicians, not the 
researchers or the teachers, who will decide whether English is here 
to stay in Dutch primary schools. 
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